Method and Apparatus for Automatic Second Screen Engagement

ABSTRACT

A method includes displaying content on a television, detecting a personal display device in proximity of the television, detecting a selection of content displayed on the television, detecting an instruction associated with the selection, displaying, based on the instruction, information associated with the selection on the personal display device and displaying on the television an alert indicating that the information associated with the selection is on the personal display device.

FIELD OF INVENTION

The invention generally relates to viewing content, and moreparticularly relates to viewing content through a second screen in astreaming environment.

BACKGROUND

Consumers have an increasing amount of on-demand media content availableto them. For example, on-demand media content includes visual content(e.g., movies, television shows, still images), audio content (e.g.,music), and software applications (e.g., games).

With an increasing amount of on-demand content available, it becomesmore challenging for consumers to find, select and view content ofinterest.

SUMMARY

A method includes displaying content on a television, detecting apersonal display device in proximity of the television, detecting aselection of content displayed on the television, detecting aninstruction associated with the selection, displaying, based on theinstruction, information associated with the selection on the personaldisplay device and displaying on the television an alert indicating thatthe information associated with the selection is on the personal displaydevice.

BRIEF DESCRIPTION OF THE DRAWINGS

The following figures depict various embodiments for illustrativepurposes. From the figures and corresponding description, differentembodiments may be employed without departing from the invention asdescribed herein.

FIG. 1 illustrates a system configured in accordance with an embodimentof the invention.

FIG. 2 illustrates server modules utilized in accordance with anembodiment of the invention.

FIG. 3 illustrates server data utilized in accordance with an embodimentof the invention.

FIG. 4 illustrates a streaming media client device configured inaccordance with an embodiment of the invention.

FIG. 5 illustrates processing operations associated with an embodimentof the invention.

FIG. 6 is an exemplary screen shot according to one embodiment of theinvention.

DETAILED DESCRIPTION

FIG. 1 illustrates a streaming environment 100. The streamingenvironment 100 includes an interface system 110, a platform server 120and one or more sources of content programming 135. In one embodiment,the interface system 110 includes a display device 140 (e.g., monitor ortelevision), a client device 150 (e.g., a streaming media player), auser input device 170 (e.g., a remote control) and a personal displaydevice 175. The client device 150 is configured to communicate with thedisplay device 140, the personal display device 175 and a network 160.

In one embodiment, the platform server 120 includes a database 125 withplatform data and a platform module 130. The database 125 is configuredto store data such as programming software packages. The data withinthese programming software packages include the network locations andcontent descriptions of content sources 135, hardware/softwarecapabilities of different firmware versions and specifications of theclient device 150, customer data associated with each client device 150and user interface information associated with the client device 150.

In one embodiment, the customer data includes customer specificinformation such as demographic data, geographic data, ISPidentification and financial information. In one embodiment, theplatform server 120 generates customized user interfaces for each of theclient devices 150. In one embodiment, the user interface from theplatform server 120 provides a selection of content such as audio,visual and gaming content to the client device 150. In this example, theplatform server 120 is configured to supply a graphical representationof selectable content to the client device 150. The client device 150selects and accesses individual content through this graphicalrepresentation.

In one embodiment, the platform server 120 is configured to receiveinput from client device 150 and processes the input through theplatform module 130. The input from the client device 150 includesnavigation and selection commands which may represent selection ofcontent, search for content, and ongoing interaction with an applicationrunning on the platform server 120.

In one embodiment, the client device 150 displays content on displaydevice 140. In one embodiment, the content displayed on the displaydevice is sourced from one of the client device 150, the platform server120 and the content source 135. In one embodiment, the input device 170transmits signals to the client device 150. In embodiment, the inputdevice 170 utilizes one of or a combination of an infrared signal, radiofrequency signal and Bluetooth signal to communicate with the clientdevice 150.

The input device 170 is configured to enter data and to make userselections from the interface as presented through the client device150. In one embodiment, the interface shown through the client device150 is based on the platform server 120, from the content sources 135 orlocally from the client device 150. In one embodiment, the input device170 also includes a display to show additional content. In anotherembodiment, the input device 170 includes a touch screen which allowscontent to be displayed and input to be received. Exemplary inputdevices 170 include remote controls, smart phones, tablets, and mobilecomputers.

The personal display device 175 is configured to display either throughthe client 150 or through the internet 160. In one embodiment, thepersonal display device includes smart phones, computers, tablets, andmobile computers. The personal display device 175 may be the inputdevice 170. In one embodiment, the personal display device receivescontent from the client device 150, the internet 160 and the platformserver 120 for display.

In one embodiment, the content sources 135 include a server 180 and astorage device 190. In one embodiment, the network address of particularcontent stored within the storage device 190 is maintained within theplatform server 120. In another embodiment, the general location of thecontent source 135 is maintained and stored within the platform server120 while the specific locations of corresponding content are managedlocally by the content source 135. In yet another embodiment, thelocation of the content source 135 is embedded within the graphicalrepresentation displayed through the client device 150 such thatinteraction with the graphical representation through the client device150 allows the content located within the content source 135 to beaccessible to the client device 150.

In one embodiment, the content stored within the storage device 190includes music, video, still pictures, text, graphics, gamingapplications and the like. In one embodiment, the particular contentwhich is stored within the storage device 190 is provided to the clientdevice 150 through the network 160. In one embodiment, the network 160is the Internet. In another embodiment, the network 160 is a local areanetwork.

In one embodiment, the client device 150 makes a request for specificcontent. If the requested content is video content, the storage device190 transmits video data that represents the specific video content tothe client device 150 through the content source 135. In one embodiment,platform server 120 supports interfaces, such as login interfaces,search interfaces, and customized interfaces for the client device 150.

FIG. 2 illustrates a representative platform module 130 as shown inFIG. 1. In one embodiment, the platform module 130 includes anauthentication module 205, a search/browse module 210, a match module215, a store module 220, a tag module 225, a display module 230, arecommendation module 235, and a channel store module 240.

The authentication module 205 interacts with the client device 150 andauthenticates a profile or user account associated with the particularclient device 150. For example, the profile includes data associatedwith a user such as the user name, password, device associations, IPaddresses, location, email address, payment information and contentsubscriptions. In one embodiment, the authentication module 205recognizes and authenticates the client device associated with aparticular user account through password authentication, locationauthentication, visual authentication, or audio authentication. Theauthentication can be configured to occur when setting up a new clientdevice 150, purchasing content or subscriptions, or periodically asneeded.

The search/browse module 210 is configured to detect input from a clientdevice 150 and/or the input device 170. In one embodiment, the inputrepresents the selection of a channel, content or application. Inanother embodiment, the input represents a textual, visual or audiblesearch for content, a channel or application. In yet another embodiment,the input represents browsing content, channels or applications.

The match module 215 coordinates searches and requests for content,channels and applications. For example, the match module 215 identifiesrelevant content, channels and applications based upon the searchcriteria. In one embodiment, the match module 215 relies on titles,tags, description and reviews associated with the content, channels andapplications to determine relevance of the match.

The store module 220 coordinates the storage of data within the platformserver 120. The data coordinated by the store module 220 includescontent listings and corresponding descriptions, user profiles,searching and browsing requests, content viewed, channels andapplications utilized, tags and friends. Depending on the nature of thedata, access to the content is controlled to prevent unauthorized use.

The tag module 225 coordinates the creation and use of tags associatedwith content, channels and applications. Tags can be assigned tochannels and applications by the author of the channels and applicationsor by users through the client device 150. Tags can also be assigned toportions of audio and video streams by the author of the audio and videostreams or by users through the client device 150. The tags may describethe corresponding content or allow an opportunity for a user to providecommentary associated with the corresponding content. The tags can beused for personal use and searched by the user creating the tags or thetags can be aggregated among multiple users and searched through apublic database by others.

The display module 230 coordinates display of representative content anduser interfaces from the platform server 120 to each of the clientdevices 150. Examples of representative content include listings anddescriptions of channels, content and applications. Further, the userinterface is configured to allow searching and browsing for channels,contents and applications.

The recommendation module 235 is configured to process contentrecommendations based on a combination of current subscriptions,browsing or searching input and content source. Further, therecommendation module 235 also can utilize tags to providerecommendations. In another embodiment, the recommendation module 235utilizes the availability of the content to provide a recommendation.For example, a viewing window may describe when the content is availablefor viewing, such as a beginning and end date to access the content.Further, the recommendation module 235 also can utilize the subscriptiondata associated with each user account to determine whether the contentis available to the user without additional charge because the accountuser is already subscribed to the content provider. Further, therecommendation module 235 can prioritize content that is available freeof charge without any subscriptions. In another embodiment, therecommendation module 235 prioritizes content based on popularityratings as derived from the public viewing data 335.

The channel store module 240 is configured to manage subscriptions ofchannels associated with each client device 150. Channels often containcontent such as video content and audio content. In one embodiment,access to the content within a channel requires a subscription to thatchannel, but the subscription is free. In another embodiment, access tothe content within a channel requires a paid subscription. In yetanother embodiment, access to some content and applications requirepayment and a subscription. In one embodiment, the channel store module240 manages the addition of channels, content and applications.Similarly, the channel store module 240 also manages deletion ormodifications to channels, content and applications.

FIG. 3 illustrates a representative platform database 125. In oneembodiment, the platform database 125 includes private data and publicdata. The private data contains information which is associated with aparticular user; the public data contains information that is aggregatedand not associated with a particular user. The private data within theplatform database 125 includes user profile data 305, user viewing data310, user subscription data 315, user tagging data 320, user connectiondata 325 and user device data 330. The public data within the platformdatabase 125 includes public viewing data 335, public tagging data 340and content listing data 345.

In one embodiment, utilization of the private data is restricted toaccess within the platform server 120 and access by a particular user tohis or her private data. Utilization of the public data can be accessedby all users and selected third parties.

The user profile data 305 includes information such as a user's name,address, credit card/payment information, age and gender. The userviewing data 310 includes the channels, audio content, visual content,video content and applications utilized through a client device 150. Inone embodiment, the user viewing data 310 allows a client device 150that is associated with the particular user to view recently watchedchannels and content as well as determine which applications wererecently used. Further, the user viewing data 310 also includes storedsearches that are performed through devices associated with this useraccount. In one embodiment, the stored searches are initiated byexplicitly searching for content through a text based, image based orvoice based search. In another embodiment, the stored searches areimplicitly identified by recording browsing choices.

The user subscription data 315 includes information such as channelssubscribed by a particular user and content and applications purchasedby the particular user. The user tagging data 320 includes tagginginformation related to a particular user. For example, the tagginginformation can include a user's comment or description of a channel,application or content. In one embodiment, the entire content is taggedwith a description as determined by the particular user. In anotherembodiment, a portion of the content is tagged with a description ofthat portion of the content by the particular user. The user connectiondata 325 includes a listing of other users that are associated with theparticular user as a friend. In one embodiment, having users connectedto each other as friends allows a particular user to share recentlywatched content, channel subscriptions, user tags and applications withother connected users. The user device data 330 includes a listing ofdevices associated with the particular user. The device includes aclient device 150, an input device 170, a mobile device such as atablet, laptop computer, or smart phone.

The public viewing data 335 includes a listing of channels, content andapplications utilized by many users in aggregate. In one embodiment, thepopularity of the content is ranked based on the number of viewers andthe order in which the content is viewed. For example, the higher numberof views per day for content would indicate higher popularity. Further,when multiple content options are presented next to each other, thecontent which is selected first for viewing is given a higher popularityrating.

The public tagging data 340 includes tags that are utilized to describechannels, content and applications from many users in aggregate. In oneembodiment, the tagging data within the public tagging data 340 comesfrom content providers. For example, a movie studio responsible forproducing a movie could provide tagging data to the public tagging data340 that describes portions of the movie. The public tagging data alsoincludes closed captioning and subtitles associated with respectivesegments of the content.

The content listings data 345 includes listings of content anddescriptions of the corresponding content. In one embodiment, thedescriptions include key word tagging throughout the content, a summarydescription of the content, directors and actors associated with thecontent and third party reviews associated with the content.

FIG. 4 illustrates a block diagram of a representative client device150. In one embodiment, the client device 150 is configured to receivestreamed content. The content streamed into the client device 150includes audio content, visual content and applications. In oneembodiment, the client device 150 is utilized to transmit instructionsand selections to the content server 135 and/or the platform server 120.

In one embodiment, the client device includes a processor 410, internalmemory 420, external storage 430, multipurpose I/O port 440, inputdevice interface 450, power management 460, audio/visual I/O interface470 and network interface 480.

In one embodiment, the processor 410 utilizes a central processing unit(CPU). In another embodiment, the processor 410 also utilizes a graphicsprocessing unit (GPU) which may be integrated with the CPU or beconfigured to be physically separate. In one embodiment, the internalmemory 420 includes one of or a combination of random access memory(RAM), flash memory, and read only memory (ROM). Additional memory andmemory interfaces such as the multi-purpose I/O port 440 may be providedin various embodiments, to support memories such as the external storage430 which can include hard disks, USB drives, SD cards, and the like.These memories may also be used for storage of applications, programs,buffered media, media, executable computer code and software keys.

In one embodiment, the input device interface 450 enables an inputdevice to interface with the client device 150. In one embodiment, theinput device interface 450 is configured to communicate with the inputdevice through a wireless interface such as Bluetooth (BT), radiofrequency (RF), and infrared (IR). In one embodiment, the input deviceinterface 450 supports the functionality through an input deviceincluding any combination of virtual buttons embodied on a customizationscreen, physical buttons, accelerometer, gyroscope, pressure sensor,tilt sensor, magnetic sensor, microphone, and light sensor.

In one embodiment, the I/O interface 470 supports multiple video outputoptions such as High Definition Multimedia Interface (HDMI),Red-Green-Blue (RGB) component video, Separate Video (S-video), DigitalVisual Interface (DVI), Video Graphics Array (VGA), MobileHigh-Definition Link (MHL) and composite video. In one embodiment, USBand Apple® Thunderbolt® enabled displays are also supported.

In one embodiment, the network interface 480 supports multiple networkinterfaces such as Ethernet, Wi-Fi and Bluetooth. In another embodiment,the network interface 480 also supports coaxial, digital TV antenna, andsatellite television.

FIG. 5 illustrates a flow diagram showing exemplary embodiments forusing the streaming environment 110 and the platform server 120. Theblocks within the flow diagram are shown only for illustrative purposes.For example, blocks within the flow diagram can be further divided,combined or performed in a different order without limiting the scope ofthe claims.

Initially, content is displayed 510. For example, selected content maybe displayed through a client device 150 and a personal display device175. In Block 505, a personal display device 175 is detected. In oneembodiment, the personal display device 175 is detected within aphysical proximity to the client device 150. The physical proximity canbe set based on the local environment of the client device 150.

In Block 510, the display device 140 (e.g., the television) displayscontent through the client device 150. In one embodiment, the contentdisplayed on the display device 140 includes streaming video, an imageand a textual representation.

In Block 515, selection of the content displayed on the display device140 is detected. If the selection of the content displayed on thedisplay device 140 is detected in Block 520, then a determination ismade on how to display the selected content. For example, the selectedcontent is analyzed for suitability for utilization on the displaydevice 140 and the personal display device 175. In one instance,selected content containing long textual passages such as a review onvideo content would be better suited for utilization on the personaldisplay device 175 instead of the display device, because reading textis easier on the personal display device 175 instead of the displaydevice. Conversely, the selected content containing video clips are moresuited for display on the display device 140.

In another embodiment, if the selected content includes both a textualcomponent and a video component, the textual component would be moresuited for display on the personal display device 175, and the videocomponent would be more suited for display on the display device 140. Inthis embodiment, the textual component could be displayed on multiplepersonal display devices.

In Block 530, if the selected content is more suitable for display onthe display device 140, then the content is displayed on the displaydevice 140 within Block 545.

If the selected content is more suitable for display on the personaldisplay device 175, then the content is displayed on the personaldisplay device 175 within Block 535. In one embodiment, portions of theselected content can be displayed on both the display device 140 and thepersonal display device 175.

In Block 540, a visual indictor is displayed indicating that theselected content is being displayed on the personal display device 175.The visual indicator is graphically displayed on the display device 140.In one embodiment, the visual indicator is a flashing screen. In anotherembodiment, the visual indicator is an icon. In yet another embodiment,the visual indicator is a change in color of the display.

FIG. 6 illustrates a screen shot showing exemplary embodiments for usewith the streaming environment 110 and the platform server 120. Therepresentations within the screen shot are shown only for illustrativepurposes. For example, contents within the screen shot may be omitted oradded without limiting the scope of the claims.

FIG. 6 illustrates an exemplary screen shot 600 depicting a userinterface for displaying content on the display device 140 and thepersonal display device 175. In one embodiment, the screen shot 600 isan exemplary screen a shown on the display device 140. The screen shot600 includes an icon 610, a link to content 620 and a frame 630.

In one embodiment, the icon 610 represents an indication on the displaydevice 140 that content is currently being displayed on the personaldisplay device 175. In one embodiment, the icon 610 is only present whencorresponding content is being displayed on the personal display device175. In another embodiment, the icon 610 flashes or changes colors whencorresponding content is being displayed on the personal display device175.

In one embodiment, the link 620 represents the content that is currentlybeing displayed on the personal display device 175. In one embodiment,the link 620 flashes or changes colors when corresponding content isbeing displayed on the personal display device 175.

In one embodiment, a change in color or other visual indicated on theframe 630 represents an indication on the display device 140 thatcontent is currently being displayed on the personal display device 175.

An embodiment of the present invention relates to a computer storageproduct with a computer readable storage medium having computer codethereon for performing various computer-implemented operations. Themedia and computer code may be those specially designed and constructedfor the purposes of the present invention, or they may be of the kindwell known and available to those having skill in the computer softwarearts. Examples of computer-readable media include, but are not limitedto: magnetic media such as hard disks, floppy disks, and magnetic tape;optical media such as CD-ROMs, DVDs and holographic devices;magneto-optical media; and hardware devices that are speciallyconfigured to store and execute program code, such asapplication-specific integrated circuits (“ASICs”), programmable logicdevices (“PLDs”) and ROM and RAM devices. Examples of computer codeinclude machine code, such as produced by a compiler, and filescontaining higher-level code that are executed by a computer using aninterpreter. For example, an embodiment of the invention may beimplemented using JAVA®, C++, or other object-oriented programminglanguage and development tools. Another embodiment of the invention maybe implemented in hardwired circuitry in place of, or in combinationwith, machine-executable software instructions.

The foregoing description, for purposes of explanation, used specificnomenclature to provide a thorough understanding of the invention.However, it will be apparent to one skilled in the art that specificdetails are not required in order to practice the invention. Thus, theforegoing descriptions of specific embodiments of the invention arepresented for purposes of illustration and description. They are notintended to be exhaustive or to limit the invention to the precise formsdisclosed; obviously, many modifications and variations are possible inview of the above teachings. The embodiments were chosen and describedin order to best explain the principles of the invention and itspractical applications, they thereby enable others skilled in the art tobest utilize the invention and various embodiments with variousmodifications as are suited to the particular use contemplated. It isintended that the following claims and their equivalents define thescope of the invention.

1-16. (canceled)
 17. A method, comprising: delivering to a client devicecontent for display on a television; detecting a selection of contentdisplayed on the television; analyzing the selection for suitability forpresentation of associated content on either a personal display deviceor the television; and delivering, based upon the analyzing, theassociated content to either the personal display device or the clientdevice for display on the television.
 18. The method of claim 17 furthercomprising supplying to the client device an alert for display on thetelevision, wherein the alert indicates that the associated content isdisplayed on the personal display device.
 19. The method of claim 17further comprising detecting with the client device when the personaldisplay device is in proximity to the client device.
 20. The method ofclaim 17 further comprising detecting an instruction associated with theselection.
 21. The method of claim 17 wherein delivering includesdelivering the content from a server to the internet to the clientdevice.
 22. The method of claim 17 wherein the content is selected fromvisual content, audio content and software applications.
 23. The methodof claim 17 wherein the content is an electronic programming guide.